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1  INTRODUCTION 


The  random  version  of  the  classical  single-constraint,  0-1  linear  programming 
problem  is  given  by 

Vn=  max  ^XiSi  (1.1) 

t=i 

n 

subject  to  <1  Si  £  {0,1} 

»=i 

where  the  pairs  (IT,-,  AT,)  are  assumed  to  be  independent  draws  from  a  common 
joint  distribution  Fwx-  we  think  of  the  pairs  {W,-,X,)  as  the  weights  and  values, 
respectively,  of  a  collection  of  n  objects,  then  this  problem  can  be  thought  of  as 
finding  the  collection  of  objects  of  maximum  value  which  will  fit  in  a  “knapsack” 
with  weight  capacity  1. 

In  this  paper  we  shall  compute  the  asymptotic  value  of  the  random 
variables  V"„  with  increasing  n,  for  a  very  large  class  of  joint  distributions 
Fwx- 

Frieze  and  Clarke  (1984)  computed  the  asymptotic  value  of  this  random  knap¬ 
sack  problem  for  a  particular  Fwx  (where  W  and  X  are  mutually  independent 
and  both  uniformly  distributed  on  the  interval  (0,1))  as  part  of  their  analysis  of  ap¬ 
proximation  algorithms  for  the  deterministic  knapsack  problem.  In  a  related  paper, 
Meante,  Rinnooy  Kan,  Stougie,  and  Vercellis  (1984)  analyze  a  random  knapsack 
problem  in  which  the  knapsack  capacity  grows  in  proportion  to  the  number  n  of 
items.  Under  this  assumption,  the  question  as  to  the  growth  rate  of  Vn  is  easily 
resolved — the  strong  law  of  large  nximbers  guarantees  that  Vn/n  converges.  Among 
their  results,  Meante  et  al  compute  this  limit.  In  contrast,  when  the  knapsack  ca¬ 
pacity  is  fixed  the  growth  rate  of  Vn  depends  on  the  joint  distribution  of  weights 
and  values.  This  dependence  is  our  main  interest  here. 

In  section  2  we  state  and  prove  our  main  result  (Theorem  l)  characterizing 
the  asymptotic  value  of  Vn.  In  section  3  we  present  some  examples.  In  one  of 
them  (Example  2)  we  apply  Theorem  1  to  a  multiconstraint  knapsack  problem  of 
Frieze  and  Clarke  (1984)  to  obtain  a  new  asymptotic  upper  bound  for  the  value 
of  this  problem.  In  fact,  our  upper  bound  turns  out  to  be  the  asymptotic  value 
(Schilling  (1988)).  We  also  consider  a  class  of  examples  in  which  weight  and  value 
are  functionally  related. 
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2  RESULTS 


We  define  V„  as  in  (l.l).  Our  goal  is  to  compute  the  asymptotic  value  of  as 
n  — oo.  Let  us  begin  with  2  easy  cases. 

(i)  Suppose  that  P{W  =  0  and  X  >  0)  >  0.  Then  Vi,  grows  linearly  in  n.  To 

prove  this,  let  Xj  =  5,-  •  l{vv  =o>.  Then  E(X')  =  lim  <  Hminf — 

V  X  +  •  •  •  +  X 

<  limsup—  <  lim  — - - ^  =  E{X)  a.s.  (The  equalities  follow  from  the 

strong  law  of  large  numbers) .  Thus  we  shall  require  that  W  >  0. 

(ii)  Suppose  that,  for  some  t,  ^  <  t  a.s.  Then,  for  all  n,  Vi,  <  t;  Vi,  doesn’t  grow 
at  all.  Thus  we  shall  require  that  ^  be  unbounded. 

We  now  officially  assume  the  common  joint  distribution  Fwx  of  the  pairs  (W,-,  X,) 
satisfies 


tv  >  0  and  0  <  X  <  1,  the  random  variable  ^  is  continuous, 
and  its  density  fjL{t)  is  positive  for  all  sufficiently  large  t. 


(Al) 


(We  shall  also  require  a  “regularity”  assumption  (A2),  which  we  postpone  stating 
until  after  lemma  1  when  we  will  have  had  a  chance  to  motivate  it.) 

Definitions:  Let  (Zn)  be  a  sequence  of  random  variables,  and  (xn)  a  sequence  of 
numbers.  We  write  Zn  ~  x„  to  mean  that  P(x„(l  -  c»(l))  <^n<Xn(l+o(l)))-l 
as  n  -♦  00.  As  usual,  o(l)  denotes  a  sequence  that  converges  to  0  as  n  — ♦  oo. 
This  is  the  standard  notion  of  “almost  everywhere”  for  random  combinatorics  (as 
in  Bollabas  (1985),  e.g.). 

For  t  >  0,  let  F(f)  =  E(W  •  l{^>,j),  and  G(t)  =  E{X  ■  l{i>«}). 

Our  analysis  begins  by  collecting  some  simple  facts  about  the  functions  F  and  G, 

Lemma  1  (i)  For  all  sufficiently  large  t,  F[t)  and  G{i)  are  continuous  and 

monotone  decreasing,  and  lim  F{t)  =  lim  G(f)  =  0. 

i^OO  I— +00 

(ii)  F~^(t)  exists  for  all  sufficiently  small  positive  t,  and  lim  F“^(t)  =  oo. 

t-*o+ 

(Hi)  GoF~^{t)  is  monotone  increasing  on  some  interval  (0,e),  and  liin  G  o  F~^(t)  =  0. 
GoF-^(t) 

(tv)  hm - : — —  =  oo. 

'  '  t-o+  t 
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Proof:  From  assumption  (Al)  we  can  see  that  P{^  >  1)  decreases  montonically  to 
0  as  t  oo.  (i)  follows  almost  at  once,  then  (ii)  follows  from  (i),  and  (iii)  from  (i) 
and  (ii).  To  prove  (iv),  note  that 

G(u)  =  E(X  ■  >  E{uW  ■  =  »F(»). 

Let  u  =  then  we  have 

G  o  F-^{t)  >  i.e.  ^  °  >  F-^{t), 

and  so  (iv)  follows  from  (ii).  H 

In  light  of  (iii),  we  let  GoF~^(0)  =  0.  Thus  GoF~^  is  continuous  at  0,  increasing 
to  the  right  of  0,  and  has  infinite  derivative  at  0.  Any  reasonable  function  with 
these  properties  will  be  concave  (i.e.,  lie  above  its  chords)  on  some  interval  [0,  s]. 
We  shall  assume  from  here  on 

(A2)  for  some  e  >  0,  G  o  F~^  is  concave  on  the  interval  (0,  e]. 

The  purpose  of  (A2)  is  to  facilitate  the  proof  of  the  following  technical  lemma. 


Lemma  2  There  exist  sequences  (t„),  (u„)  of  positive  numbers  with  the  following 
properties: 

(i)  For  all  n,  JF’(fn)  >  -  >  F(u„). 

n 

(ii)  As  n  oo,  nF(f„)  — »  1  and  nF(u„)  —»■  1. 


(iii)  As  n 

(iv)  As  n 


oo,  t„(l  -  nF{t„)y  ->■  00  and  u„(l  -  nF(u„))* 

G(l„)  G(u„)  ^  , 

■GoF-i(i) 


Proof:  Note  that,  for  all  s  >  0,  by  Lemma  l(ii),  for  all  sufficiently  lau'ge  n,  F“^(^(l+ 
e))  •£*>!.  Let  Nf  =  min{n  :  F“^(^(l  +e))  •£*  >  ^}.  Now  N,  oo  as  e  0"^,  so 
there  exists  a  sequence  (6„)  of  positive  numbers  such  that  -+  0  as  n  — >  oo,  and 
Ns^  <  Ns^  <  TVjg  <  —  Finally,  let 

1  if  n  <  ATf, 

if <n<  Ng^ 
h  \iNg,<n<Ng, 
etc. 
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Now  it  is  easy  to  check  that  — >  0  and  F“^(^(l  +  £„))  •£„—*  oo  as  n  —*  oo. 
Finally,  let  +  e„)).  The  parts  of  i-iii  having  to  do  with  t  follow  easily. 

To  verify  the  t-part  of  iv,  we  require  a  sublemma. 


Sublemma  3  Suppose  that  H  is  a  non-negative,  concave  function  on  [0,e],  and 

jg'(O)  =  0.  Then  if  a  >  1  and  ax  G  [0,£|,  then  <  <*•  //  0  <  a  <  1,  then 

n[x) 

Hjax) 

H{x)  >  • 

Suppose  a  >  1,  then  ax  >  x,  and  because  of  the  concavity  of  H  we  have 

Hjax)  -  H{x)  ^  H{x) 

ax  —  X  X  ‘ 

Therefore, 

H(ax)  ,  ,  H{ax)-H{x)  x  .  . 

H{x)  ax  —  x  H[x) 

The  second  assertion  follows  since  0  <  a  <  1  implies 

H{x)  -  Hjax)  Hjax) 

X  —  ax  ax  ' 

Now  apply  sublemma  3  with  H  =  Go  F~^,  ®  =  n’  a  =  1  +  £n-  We  have,  for  all 
large  enough  n, 

g('n)  + 

g,;-i(i)  Goji->(i) 

On  the  other  hand,  since  G  o  F~^  is  increasing. 


GoF-»(i(l+^n)) 


GoF-Mi)  -  ’ 

and  the  t-part  of  (iv)  follows.  The  u-parts  of  lemma  2  are  proved  by  replax:ing  1  +  £ 
everywhere  by  1  —  £.  H 

We  now  state  and  prove  our  main  result: 

Theorem  1  Vn  ~  n  •  G  o  F“^(^),  where  Vn  is  as  defined  as  in  (1.1). 


Proof: 


YoTt>0\etWn{t)  = 
and  X„{t)  = 
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Now  it  is  easy  to  compute  =  nF{t)  ajid 

Var(»'„(f))  <  nE{W^  ■ 

<  jE{W  •  since  X  <  1  and  ^  >t  imply  W  <  ^ 

=  nF{t)ft. 

Let  {tn)  be  as  in  lemma  2.  We  have 

P(^n(«n)  <  1)  =  P{WM  -  ^(»^n(<n))  <  1  " 

nF(tn) 

<  f  (1  -  nF{t  ))»  Chebyshev’s  inequality). 

Thiis,  by  lemma  2,  P(W„(t„)  <  1)  — »  0  as  n  — >  oo.  By  a  symmetrical  argument, 
P{W„{un)  >  1)  — >  0  as  n  -+  oo.  Hence 

P{^nitn)  >  1  >  t^n(Un))  -»  1  as  n  -+  OO.  (2.1) 

Next  recall  the  greedy  algorithm  for  problem  (1.1).  Order  the  pairs  (W,,  Xi)  so 
that  ^  <icnote  the  value  obtained  in  (1.1)  by 

the  greedy  algorithm,  then  =  X(i)  +  •  •  •  +  X[t),  where  k  is  the  greatest  number 

among  1, . . . ,  n  such  that  W(i)  H - f-  W{jt)  <  1.  In  particular  if  W„(t)  >  1  >  Wn(w), 

then  X„(f)  >  >  X„(u).  Thus  from  (2.1)  we  have 

P{Xn{tn)  >  Vl  >  Xn(u„))  1  as  n  -♦  oo.  (2.2) 

Finally  compute, 

■^'(Xn(tn))  =  »iG(tn)  and 

Var(X„(t„))  <  nE{X^  •  l^i>,j) 

<  nE{X  •  l^^>,j)  since  X  <  1 
=  nG(t„), 

=  l/”G(t„).  Now  by  lemma  l(iv),  as  n  -♦  oo,  nGoF’-^(l)  -v  oo,  so 
by  lemma  2(iv),  nG(Q  ->  oo.  Thus  by  Chebyshev’s  inequality,  X„(t„)  ~  nG(tn). 
By  another  use  of  lemma  2(iv),  we  have  X„(t„)  ~  nG  o  F"^(i).  By  a  synunetric 
argument,  applied  to  u„,  it  can  be  shown  that  X„(u„)  ~  nGo  F“^(^).  Thus,  by 
(2.2),  ~  nG  o  F“^(i).  But  it  is  well  known  that  V',!  <  <  V,J  +  1;  therefore 
Vn  ~  nG  o  F~^{^),  which  completes  the  proof  of  theorem  1.  M 
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3  Examples 


Example  1  (Frieze  and  Clarke,  1984).  Consider  the  knapsax:k  problem  (1.1)  where 
W  and  X  are  mutually  independent  and  both  distributed  uniformly  of  the  interval 
(0,1).  For  t  >  1,  we  have 


F(t)  =  =  j 


wdwdx  =  — -r. 


xdwdx  =  — . 


Therefore,  by  Theorem  1,  V„  ~  nG  o  F  ^(^)  =  This  duplicates  a  result 

originally  obtained  in  Frieze  and  Clarke  (1984). 


Example  2  (Frieze  and  Clarke,  1984).  Consider  the  m-dimensional  knapsack  prob¬ 
lem 


max  (3-1) 

subject  to  E"=i  ^ij^j  for  t  =  1, 2, . . . ,  m,  6j  6  {0,  l}. 

The  Wij  and  X,-  are  assumed  to  be  mutually  independent,  and  all  uniformly  dis¬ 
tributed  on  the  interval  (0,1).  This  problem  may  be  compared  to  two  related 
one-dimensional  problems: 

=  max  XjSj  (3.2) 

subject  to  ^>^{0,1}, 

where  W_j  =  max{lViy,  IVjy, . . . ,  W^nj}  for  j  =  1, 2, . . . ,  n  and 


V„=  max  (3.3) 

subject  to  6yG{0, 1}, 


where 


for  y  =  1,2, . . .  ,n. 


It  is  not  hard  to  see  that  we  have  A  series  of  computations,  along 

with  Theorem  1,  show  that 


/  (m  -I-  l)"*n  \ 
Vm’”(m  -I-  2)  j 


and  Vn 


(m-t- 
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Hence 


P 


(m  +  l)”*n 
m"‘(m  +  2) 


-  o(l))  <  V’n  <  (m  + 


1 

(3.4) 


as  n  — >  oo. 


The  lower  bound  in  (3.4)  duplicates  a  result  in  Frieze  and  Clarke  (1984).  The 
upper  bound  in  (3.4)  is,  so  far  as  we  know,  new.  Furthermore,  it  is  sharp.  Indeed, 
it  is  shown  in  Schilling  (1988)  that 


Vn  ~  (m  + 


Our  third  example  relates  the  shape  of  the  joint  density  of  W  and  X  near  the  x-axis 
to  the  growth  rate  of  the  value  of  the  knapsack. 

Example  S:  Suppose  that  for  some  e  >  0,  fwxi^,^)  =  on  the  set 

{(x,u;)|^  >  s}.  Then,  for  t  >  e, 


=  /  /  xau/^x^^dwdx 

J  J 


a 


{01  +  l)(/^i  +  /^2  + 


f'il)  —  f  f  aww^^x^^dwdx 

J  J 


Thus,  by  Theorem  1, 


a 


{01  +  2)(/?i  +02  +  3)f^>+* 


The  hypotheses  of  Theorem  1  do  not  require  that  W  amd  X  be  jointly  continuous, 
only  that  ^  be  a  continuous  random  variable.  When  weight  and  value  are  related 
in  a  deterministic  fashion,  Fwx  niay  be  singular  with  respect  to  Lebesgue  measure 
on  (0, 1)*,  but  ^  still  nonetheless  continuous.  Our  final  example  is  such  a  case. 
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Example  4-  Consider  the  problem 


V;,  =  max  X;r=i  (3-4) 

subject  to  XfSi  <1  G  {0,1}, 

where  a  >  1,  and  eax:h  Xi  is  uniform  on  the  interval  (0,1). 

Then 

f  (1)  =  E(X-  ■  i(x.-.>.))  = 

a  +  1 

and 

so,  by  Theorem  1, 

Vn  ~  —  (o!  + 
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